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METHOD OF COMBINATORIAL MULTIMODAL OPTIMISATION 

The present invention relates to methods of combinatorial multimodal 
optimisation, and in particular to the use of genetic algoritiims for solving 
5 combinatorial multimodal optimisation problems. The invention is expected to 
find particular although not exclusive application in the fields of load balancing 
(e.g processor and network load balancing), scheduling optimization (including 
production scheduling, resource assignments, timetable scheduling) and 
resource planning. 

10 

An optimisation problem is always a simplication of a real world problem, an 
engineer needs to suggest various possible optimal solution alternatives to the 
decision maker in order to understand this problem better. 

15 Many problems in the scheduling of manufacturing sj^ems and artificial 
intelligence can be regarded as combinatorial multimodal optimisation 
problems, which require the determination of multiple integer solution vectors 
that maximise (or minimise) a given objective function with regard to some 
definite set of constraints. Problems of this class, which are characterised by 

20 their discreteness, high dimension and noise, are quite different firom 
multimodal continuous fimction optimisation problems. The combinatorial 
multimodal optimisation problem is arguably one of the most deceptive 
problems for GA applications. 

25 So-called genetic algorithms (GA) are well-known stochastic optimisation 
search methods which are based on a global search procedure. But the use 
simple genetic operators (selection, multi-point crossover and mutation) to 



solve a typical combinatorial multimodal optimisation problem, provides only a 
single (global or local) optimal solution for each search procedure [He Liwen 
and Mort. Neil: Genetic Algorithm for Scheduling Optimization on a Multi- 
Product Batch Processing Machine. 4^ IFAC Workshop on Intelligent 
Manufacturing Systems, Seoul, Korea, PP165-170, 1997]. The reason is tiiat, as 
there is no selective pressure among any of the peaks for the finite population in 
the fitness landscape, tiie population converges to one alternative or another 
randomly. This problem is known as genetic drift - stochastic errors in 
sanq)ling caused by small population size. In other words, this difficulty comes 
firom the fundamental theorem of genetic algorithms wHch tells us that 
exponentially increasing trials will be given to the best schemata observed, thus 
losmg some potentially useful schemata during Ihe evolution. 

Therefore, the problem is how to reduce the effect of this genetic drift and keep 
the population diversity m GA search in order to find different fitiiess peaks, 
and lead populations to move firom local optima to global optima. 

- A typical NP-hard Combinatorial Optimisation Problem could be described as 
follows [Jelasity, M. and Dombi, J: GAS, a Concept on Modelling Species m 
Genetic Algorithms. Artificial Intelligence, Vol. 99, No. 1, pp. 1-19, 1998]: 
A set ^ = {wi, W2, ... , Wn } of n integers and a large mteger P is given. We 
would like to find an 5? c Hf^ such that the sum of the elements in 5^ is close to, 
without exceeding, P, perhaps subject to some problem-specific constraint 
conditions. The number of elements in 5 is given as m. 



To take a simple example, let us assume that we have eleven jobs of various 
sizes that need to be shared, withm a computer system, between five parallel 
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processors. Each processor is capable of handling a single job of size 9, or any 
combination of smaller jobs having a total aggregate size of more than 9. 

In this example, let us assume that the eleven jobs are defined by tiie set FF = 
5 {2, 7, 5, 4, 3, 6, 2, 4, 2, 8, 1} of 11 integers; using the above terminology, n = 
1 1, m = 5, and P = 9. The task, then, is defined 5 groups of jobs such tihtat the 
sum of the values within each group is close to, but does not exceed, 9. 

One possible solution is as follows: 

10 

Processor 1: {2,7} 

Processor 2: {5,4} 

Processors: {3,6} 

Processor 4: {2, 4, 2} and 

15 Processor 5: {8, 1} 

With this solution, four of the processors have an aggregate workload of 9, 
while the remaining processor (processor 4) has an aggregate work value of 8. 
Since all of these workloads are sufficiently close to but not exceed the 
20 maximum value of 9, we say that the fitness value of this possible solution is 5» 
Since that is the same as the nximber of processors, this solution is optimal. 

Other trial solutions may give less good results. In the following groupings, 

25 Processor 1: {2,7} 
I*rocessor2: {5,4} 
Processors: {3,6,2} 



Processor 4: {4,2}; and 
Processors: {8, 1} 

only Ihe first, second and fiftti processors have a foil workload. The third 
5 processor has a workload of 11 and is so overextended, while the fourth 
processor has a workload of 6 and is imder-utilised. Since only three of the 
five groupings meet the problem criteria, flie fitness value of this possible 
solution is 3. 

10 If the number of the global optima is greater than 1 in the solution space, then 
this problem is regarded as combinatorial multimodal optimisation problem. 

Conventional genetic algorithms start with an initial population of individuals 
(trial solutions). The fitness value of each individual is evaluated according to 

15 some fimction (sometimes called tiie "objective fimction"), and there then 
follows a solution process under which individuals with higher fitness values 
have a higher probability of surviving into the next generation. Typically, 
individuals with low selection values are eUminated entirely, and individuals 
with high selection values are replicated several times, in proportion to then 

20 fitiiess value. Genetic operators such as crossover and mutation are then 
applied to the population, and the fitaess values of the new individuals are re- 
evaluated. This process continues until the algorithm converges. 

As mentioned previously, such an approach is limited because of the problems, 
25 of genetic drift, and the fact that only a single optimal solution can be obtained. 
Indeed, the very nature of the procedure tends to ensure that sub-optimal 
individuals (in terms of fitness value) ultimately become reduced and 



eliminated jfrom the population, so ensuring that as the algoriHim proceeds only 
a smaller and smaller area of the solution space is e?cplored. That may be 
mefiil for finding local optima, but at the e^spense of finding global optima. 

5 Several £^>proached have been proposed to deal with these problems, such as 
niching methods, fitness sharing, [Sareni, B and Krahenbuhl, L: Fitness 
Sharing and Niching Methods Revisited. IEEE Transactions on Evolutionary 
Computation. Vol. 2, No. 3, 1998] and parallel genetic algorithms [ 
Chipperfield A. J and Fleming, P.J: Parallel Genetic Algorithms: A Survey. 

10 Research Report No. 518, Department of Automatic Control and Systems 
Engineering, University of Sheffield, 1994]. Other techniques include those 
proposed by Siiinivas, M. and Patnaik. L.M: Adaptive Probabilities of 
Crossover and Mutation in Genetic Algirithms. IEEE Transaction on Systems, 
Man and Cybernetics. Vol. 24, No. 4, 1994; Schneider. G., Schuchhardt. J. and 

15 Wrede. P: Evolutiraiary Optimization in Multimodal Search Space. 
Biological Cybernetics, Vol. 74, No. 3, pp.203-207, 1996; Yao. X and Liu. Y: 
Fast evolution strategies. Control and Cybernetics. Vol.26, No. 3, pp.467-496, 
1997; and Jelasity, M. and Dombi, J: GAS, a Concept on Modelling Species in 
Genetic Algorithms. Artificial Intelligence, Vol. 99, No. l,pp. 1-19, 1998. 

20 

Both niche techniques and adaptive GA require a previous understanding of the 
number and the distribution of fitness peaks, and need carefiil setting of various 
parameters. Parallel GA has proven very reliable and efficient in exploring 
multimodal fitness peaks, and it also needs fewer assimiptions than niche 
25 methods. The main limitation of implementing Parallel GA is the sub- 
population size which limits Ihe total number of global optima found in the 
search. 
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According to the present invention there is provided a method of combinatorial 
multimodal optimisation for finding multiple optimal ways of dividing a set W 
of n values into m groups, such that each of the groups satisfies a respective 
constraint condition, the method comprising: 

defining an initial population of individuals, each representative 
of a trial solution; 

calculating for each individual a fitness vector indicative of 
whether the constraint condition for each group has been satisfied; 
selecting a plurality of individuals for the next generation in 
dependence upon their respective fitness vectors; 
creating a new population mcluding the selected individuals; and 
repeating steps (b) to (d) until the population stabilizes, the 
individuals of the stable population representing multiple optional 
ways of dividing the set W. 

Experimental results show that both convergence speed and quality are greatly 
improved in comparison witii other GA techniques. They also suggest that this 
novel method has the capability of generating sufficient genetic iimovations, 
preserving promising genetic diversity, guiding population escape firom local 
optima and exploring multiple global optima effectively and efficiently in this 
difficult combinatorial multimodal optimization problem. 

The novel method works through deeply preserving the population diversity 
based on a phenotypic analysis, rather than simply a. genotypic analysis. This 
reinforces the power of the method to process many building blocks in the 



(a) 

(b) 

(c) 

(d) 
(e) 



search space simultaneously. This power is stronger than that of the implicit 
parallelism found in simple genetic algorithms, and thus enhances the 
exploration of GA space for multiple optima. 

5 In tihiis novel method a hybrid drift model, through the complementary 
interaction between genetic drift and neutral drift:, can help a population escape 
away from local optima. When the relative fitness vector of one individual is 
non-dominated by that of any other one in the entire population, 'neutral drift' 
is in effects Any non-dominated individuals are regarded as having equal- 

10 (relative)-fitness values and kept for flie next generation, thus faciUtating the 
exploration of the different adaptive peaks. On the other hand, when one 
individual is dominated by another, 'genetic drift* effectively lets this less fit 
individual die out. This model has been shown to be effective in leading 
populations to escape from local optima to global optima in this typical 

1 5 combinatorial multimodal optimisation problem. 

The invention may be carried into practice in a number of ways and one 
£fpecific example will now be described, merely by way of example. 

20 Briefly stated, the preferred method of the present invention makes use of a 
genetic algorithm having the following steps: 

1. An initial population of individuals is randomly generated, each 
individual being represented by a string of integers which defines a trial 

25 solution; 

2. A fitness value and fitness vector is calculated for each individual, 
according to an objective function; 
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3. On the basis of the fitness values and the fitness vectors, suitable 
individiials are selected to form a sub-population whose size is a portion 
of the overall population; 

4. A roulette wheel selection method is then used to create offspring, fi^om 
the selected individuals, to form a new population; 

5. Highly uniform crossover and mutation is applied to the individuals of 
the new population; and 

6. Steps 2 to 5 are repeated until the algorithm converges. 

Each of these individual steps will be described in more detail below. 

Ftfst, we will consider representation and initialisation of liie population. A 
major difficulty in applying GA in a scheduling problem is finding an 
appropriate representation for the population. Here, an integer string 
representation of the individual is selected according to the following 
conditions: 

a. Completeness: the string representation should contain all possible 
individuals in the search population. • • ' 

b. Uniqueness: the string maps to the individual on a one to one basis. 

A second desideratum is to generate the initial population randomly. For 
example, a population is composed of Nchrom individuals each of which is an 
integer string with n genes. The initial population is produced by creating a 
(Nchrom X ») matrix with the con:q)onent randomly selected firom the set {1, 
m}. 

In contrast with the prior art, the fitness of each individual is determined not 
only on the basis of the fitness value but on that individual's fitness vector. 



The fitness vector is a binary vector of length m, the individual bits of which 
indicate, for that iadividual, whether the groupings satisfy or do not satisfy the 
problem constraints for each of the m groupings. 

5 To go back to the example previously discussed, in which 11 parcels of work 
have to be divided between five processors, such that no processor takes more 
than 9 work units, the fibrst solution given satisfied the constraints for all of the 
five processors. Its fitness value was therefore 5, and its fitness vector 
FV = [11111]. The second, less-good solution, satisfied the constraints only 
10 for the first, second and fifth processors, and hence had a fitness value of 3. 
The fitness vector in that case becomes [110 0 1]. 

It will be understood of course that, with this approach, the fitness value is 
simply equivalent to the number of positive bits within the fitness vector. 

15 

We now introduce some additional terminology, to be used in the remainder of 
the description. GA applications sometimes refer to the individuals within the 
evolving population as genotypes. Following that analogy, we shall refer to 
analysis using the fitness vector as phenotype or phenotypic analysis. We 
20 define the groups of combinations making up the solutions, for each individual, 
as a phenotype schema. 

To clarify this further, it may be useful to consider a further example which 
comes from a practical shoe batch processing machine (BPM) optimization 
25 problem. This problem is described in Fanti, M.P, Maione, B, PisciteUi, G and 
Turchiano, B: Heuristic scheduling of jobs on a multi-product batch processing 




machine. International Journal of Production Research, 34, pp. 2163-2186, 
1997. In this problem, « is 21, w is 7, P is 81 1, and the vector W^s defined by: 

[12 12 170 176 216 231 266 310 380 497 714 144 128 153 660 688 50 6 454 282 114] 

Thus, the problem comprises dividing iip the elements of FFinto seven groups, 
such that the sum of the elements in each group is close to but does not exceed 
811. We will now consider how, in the preferred embodiment, any fitness 
value and fitness vector is calculated for an individual or trial solution which is 
defined by an integer string £», of length 21, as follows: 

£4 5377441512675 623637 4] 

First, the twenty one integers are mapped to a trial phenotypic solution Mi 
matrix. Mi has seven columns, one for each of the seven possible groups, as 
follows: 



Group 
Ml 



Sum 
Phenotype 
schema 



1 


2 


3 


4 


5 


6 


7 


310 


714 


170 


12 


12 


144 


176 


497 


688 


50 


231 


380 


660 


216 


0 


0 


454 


266 


153 


6 


128 


0 


0 


0 


114 


0 


0 


282 


807 


1402 


674 


623 


545 


810 


802 


S\ 










S2 


. ..S3- 



As may be evident. Mi is filled with the values taken firom those values 
going into tlic columns defined by the mtegers of the string b. Thus, tlie first 



value (12) within FTgoes into column 4, the second value (12) goes into column 
5, the third value (170) goes into column 3, and so on. If a column already has 
a number in it, the next number is simply placed below. 

As shown above, the columns are then summed, and each sum is tested against 
the problem constraint conditions to see whether it complies or not The 
problem constraint conditions will of course vary from problem to problem, but 
in this particular example the conditions are that the phenotype Mi for the string 
b should satisfy the two following conditions: 

siim(5j) ^ /7 = 811 

Nc 

and (/^•sum(jj))^ p x m- sum(H^ = 811 x 7 -5663 = 14 

forj=l,2,3 

where Nc is tiie number of phenotype schemata (here 3) included in the 
phenotype M/, and is the y-th phenotypic schemata. 

In the table above^ Si, Sa and S3 are the phenotype schemata which satisfy the 
constraint conditions. Since there are three of those, the fitness value of the 
string 6 is 3. The positions of the schemata mean that the fitness vector for b is 
[1000 0 1 1]. 

More formally: 

• Assume that there are a total q of different phenotypic schema ^i, 52, ... , 
searched in a population, the phenotype schemata vector [s\^ 52, ... , 5q] 



is built up as a database of all searched phenotypic schemata in the entire 
population. 

• The phenotype of individual j can be mapped into its relative fitness binary 
vector /vG) as a bmary string in relation to the schemata vector M according 
to the following principle: 

^ ( j ) = [bi b2 ... bq] ; and hi ( z = 1, q) is abinary bit , 




1 if the phenotype of individual j includes the schema si ; 

0 if the phenotype of individual j does not include the schema si 



To take a final example, the table below shows the phenotypic schema, fitness 
value and corresponding fitness vector for four individuals 7/, 72, yj, j4, and 5 
searched phenotypic schemata, namely a, b, c, d, e: 



Individual 


Phenotypic 
schema 


Fitness value 


Fitness vector 


h 


{a,d > 


2 


f 1, 0, 0, 1,0) 


■ .. .J2 


{b,c,d,e} 


. .4. 


f 0.1.1, 1,1) 




|a,c,d,e} 


4 


f 1. 0, 1, 1,1) 


h 


{a,b,c,d,e} 


5 


ri,i,i, 1,1) 



Once the fitness value and fitness vector have been calculated for each of the 
individuals within the population, a selection process takes place to choose 
which of those mdividuals are to be retained and which discarded. The 
selection process is carried out in two stages: 



First, a reserved sub-population of the best individuals is kept. 
Individuals are chosen for this sub-population on the basis of their fitness 



vectors (and possibly their fitness values as well). One copy only of 
each individual is retained, thereby ensuring that none of the best 
individuals within the previous generation can be lost. Typically, the 
size of this sub-population is limited to around 20% of the total 
population size. 

2, Next, the remaining 80% of the spaces are filled, using a so-called 
roulette wheel section method on all of the existing individuals* Using 
this method, offspring for the next generation are created on the basis of 
the fitness values of the individuals in the current generation. The 
higher the fitness value of an individual, the more offspring (copies) of 
that individual will be retained in the next generation. Preferably, the 
number of offspring is substantially proportional to the fitness value. 

In order to understand how the reserved 20% sub-population is filled, it is 
necessary to introduce the concept of Pareto Optimality: [GoldbCTg, D.E: 
Genetic Algorithms in Search, Optimization, and Machine Learning, Reading, 
MA: Addison Wesley, 1989]. Using this concept, it may be stated that a vector 
X is partially less than j;, symbolically < p j; , when the foUowiag conditions 
hold: 

x<vy <^ (ydi^i yi)A(30(x;<y/) 

Under these circumstances we say that vector x dominates vector y. If a vector 
is not dominated by any other, we define it as nondominated. 

Turning back to the previous table, giving fitness vectors for the individuals jj, 
J2» Js^ J4,, we can say that individual j\ is dominated by both individual 73 and 74, 



but individual 72 and h are not dominated with each other. Individual U is not 
dominated by any other individuals in the population: it is a nondominated 
individual in this population. 

Different non-dominated individuals should be kept in the next generation after 
selection. Actually, most of these non-dominated individuals contain few 
schemata; they are inferior individuals with relatively smaller absolute fitness 
values, and might not continue to evolve. So these non-dominated individuals 
are ranked according to their absolute fitness value: non-dominated individuals 
with greatest absolute fitness value Ma so far are ranked as 'first class' 
individuals, and others with absolute fitness value (Ma-k) (for positive integer 
k=l, 2,...; and k<Ma) are ranked as (A:+7) class individuals. The value of A: is 
determined by the initial population size and the number of non-dominated 
individuals; the greater the value of K the more genetic diversity will be 
preserved, and the more computation complexity will be required. In this case 
study, k is chosen as 1, which means that only first-class non-dominated 
individuals searched so far are guaranteed to be preserved in &e next generation 
in order to maintain suitable genetic diversity and accelerate -conv«rgence- 



The number of non-dominated individuals is preferably fixed to a portion of 
population size, otherwise no space is available for new entries in the 
population. The size of non-dominated individuals is preferably set as 20% of 
population size. 

Once the reserved sub-population has been determined, the remaining 80% is 
filled, as mentioned above, using roulette wheel selection: Goldberg, D.E.: 



m 
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Genetic Algorithms in Search, Optimization, and Machine Learning, Reading, 
MA: Addison Wesley, 1989. In this selection, bias optimum iis used as the 
reproduction operator. The number of expected individuals is given by: 



Once the new population has been chosen, cfossovct and mutation is applied to 
it 

The basic forms of crossover are single-point, double-point, multi-point and 
uniform crossover. Single-point crossover creates two offspring from two 
parents. The parents are randomly selected from population, the crossover site^ 
Cx, is selected at random, and two of&pring are made by both concatenating the 
bits that precede in the first parent with those follow Cx in the second parent 
and performing the obverse operation. 

For multi-point crossover, multiple crossover points are chosen at random with 
no duplicates and sorted in ascending order. Then, the variables between 
successive crossover points are exchanged between the two parents to produce 
two new offspring. The section between the first variable and the first crossover 
point is kept between individuals. The following example illustrates this 
process. 



Consider the following two individuals with 1 1 binary variables each: 



individual 1 01110011010 
individual 2 10 10 110 0 10 1 



cross points =3 3 6 10 

After crossover the new individuals are created: 

offspring 1 0 1 11 0 1 1| 1 1 0 1| 1 
offepring2 1 0 11 1 0 0) 0 0 1 0|0 

The disruptive nature of multi-point crossover appears to encourage the 
exploration of the search space, rather than favouring the convergence to Wghly 
fit individuals early in the search, thus makmg Ae search more robust 

In uniform crossover, a crossover mask which is a string of binary bits with the 
size of the chromosome, is generated randomly, the value of each bit in the 
mask determines for each corresponding bit in a child, which parent it will 
inherit that bit from. An example is given to illustrate the process. 

2 5 1 4 3 6 • - • • 

4 6 2 1 5 3 

0 10 0 11 

2 6 1 4 5 3 

4 5 2 1 3 6 



Parent 1:" 
Parent 2: 
Mask: 
Child 1: 
Child 2: 



Mutation is used as a secondary operator which is randomly applied with small 
probability. It is a safety policy to be used sparingly with reproduction and 
crossover against premature convergence to a local optimum. 
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Two mutation operations are used here. One is "swap** where the two integers at 
two randomly selected distinct locations of the chromosome (individual) are 
exchanged. The other is "jump" where the integer in a randomly selected bit of 
the chromosome jumps to another feasible integer value. 

The mutation probability represents the frequency of applying the mutation 
operator. The mutation rate for jump method is determined by the following 
condition 

1 

rUu = 

bitlength 

Li addition to tiie previously mentioned techniques, further improvements can 
be achieved by including the following refinements: 

• Elitist selection strategy: the best individual is always kept in the next 
generation (see Eshelman. L.J: The CHC adaptive search algorithms: How 
to have safe search when engaging in non-traditional genetic 
recombination. Foundation of Genetic Algorithms. Gregory J,E. Rawlins 
(Eds), Morgan Kaufinann Publishers, pp.265'283, J991). Also, tiie 
stochastic universal sampling method is used to reduce sampling bias (see 
Baker. J.E: Reducing bias and inefficiency in the selection algorithm. 
Proceedings of the Second International Conference on Genetic Algorithms, 
ppl4-19, 1987). 

• A highly disruptive crossover method {Eshelman^ op cii) is used to increase 
the GA capability to exploring a broader search space to find protective 
zones which may lead to a new fitness peak. 
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The method of the preferred embodiment may be implemented, without further 
inventive input, by a skilled programmer on the basis of the description given 
above. The algorithm may be conveniently implemented along the lines of the 
following pseudocode: 

Initialisation of population 
Generation = 0 

While termination condition not satisfied DO 

Constmctphenotypic schemata vector M, fitness vector/v, through 

phenotypic cluster analysis 
Calculate the fitness value of all individuals 

Select suitable non-dominated individuals to form a sub-population whose 

size is a portion of overall population 
Select offspring to form new population using Roulette wheel selection 

method 

Apply highly uniform crossover and mutation to the new population 
Put all the sub-population into the new population 
Generation = Generation + 1 
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CLAIMS; 

1. A method of combinatorial multimodal optimisation for finding multiple 
optimal ways of dividing a set Wofn values into m groups, such that each of 
the groups satisfies a respective constraint condition, the method comprising: 

(a) defining aa initial population of individuals, each representative 
of a trial solution; 

(b) calculatiag for each individual a fitness vector indicative of 
whether the constraint condition for each group has been satisfied; 

(c) selecting a plurality of individuals for the next generation in 
dependence upon their respective fitness vectors; 

(d) creating a new population including the selected individuals; and 

(e) repeating steps (b) to (d) until the population stabilizes, the 
individuals of the stable population representing multiple optional 
ways of dividing the set W. 

2: A method as claimed in claim 1 in which the fitness vector is of length 
w, each element in the fitness vector being indicative of whether the constraint 
condition of a corresponding one of the m groups has been satisfied. 

3. A method as claimed in claim 2 in which the fitness vector comprises m 
bits, each bit being indicative of whether the constraint condition of a 
corresponding one of the m groups has been satisfied. 

4, A method as claimed in claim 1 including calculating a fitness value for 
each individual. 



5. A method as claimed in claim 4 when dependent upon claim 3 in which 
the fitness value comprises the sum of the bits in the fitness vector. 

5 6. A method as claimed in any one of the preceding claims including 
reserving a proportion of the new population for individuals selected at step (c). 

7. A method as claimed 6 in which a non-reserved proportion of the new 
population is generated using a Roulette wheel selection method. 

10 

8. A method as claimed in any one of the preceding claims in which step 
(c) comprises selecting non-dominated individuals using the criteria of Pareto 
optimality. 

15 9. A method as claimed in claim 8 when dependent upon claim 4 including 
ranking non-dominated individuals by fitness value, and selectmg fix)m the 
ranked list. 

10. A method as claimed in claim 9 in which only non-dominated 
20 individuals with greatest fitness value may be selected at step (c). 

11. A method as claimed in claim 4 in which step (c) comprises selecting 
individuals in dependence upon both their respective fitness vectors and their 
respective fitness values. 

25 



12. A method as claimed in any one of the preceding claims in which 
crossover and mutation are applied at step (d) to at least some individuals in the 
new population. 

13. A method as claimed in any one of the preceding claims in which step 
(c) comprises selecting no more than one individual for each unique fitness 
vector. 
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ABSTRACT 

A method of combinatorial multimodal optimisation uses a genetic algorithm to 
5 find simultaneous global optimal solutions to combinatorial problems* Each 
individual within the population is associated not only with a fitness value but 
with a fitness vector, using which the persistence of all of the best individuals 
into the next generation can be guaranteed. Phenotype as well as genotype 
analysis is an integral part of the method. 
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